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ABSTRACT.  The  U.S.  Air  Force  plans  for  maintenance  and  retirement  of  aircraft  based  in  part  on 
fatigue  crack  growth  models.  Periodic  inspections  are  used  to  help  assess  airworthiness  and  plan  for 
future  inspections.  Nondestructive  inspections  are  not  perfect  so  some  cracks  are  missed  and  the 
likelihood  that  an  individual  crack  is  detected  is  a  function  of  the  size  of  the  crack  when  inspected. 
Additionally,  the  crack  size  distribution  is  related  to  the  number  of  flight  hours  the  aircraft  has 
experienced,  so  not  all  inspection  results  come  from  the  same  distribution.  In  a  recent  study  several 
models  were  compared  that  utilize  the  capability  of  the  inspection  system  and  the  variation  between 
aircraft  and  times  of  inspections  to  estimate  the  distribution  of  sizes  of  cracks  that  were  missed  during  the 
inspection.  This  white  paper  summarizes  those  results  and  identifies  some  methods  for  extending  them. 

Keywords:  Probability  of  Detection,  Crack  Size  Distributions,  Statistical  Estimation 
PACS: 


INTRODUCTION 

The  Damage  Tolerant  Design  (DTD)  concept  specified  by  the  US  Air  Force  for 
aircraft  design  and  maintenance  incorporates  redundant  load  paths  and  periodic  inspections 
for  fatigue  cracks  to  ensure  safety.  A  key  part  of  the  periodic  inspections  is  the  equipment 
used  to  nondestructively  look  for  cracks.  Because  of  the  variability  in  the  shape  and 
locations  of  cracks,  not  all  cracks  will  be  found  during  an  inspection.  Many  studies  [1,2,3] 
have  shown  that  the  probability  that  a  crack  will  be  detected  generally  increases  with  crack 
size  and  a  commonly  used  model  for  the  probability  of  detection  (POD)  is  the  cumulative 
lognormal  distribution. 

The  sizes  of  cracks  that  are  found  during  an  inspection  are  commonly  used  to  assess  the 
general  state  of  a  fleet  of  aircraft  [4,5],  The  distribution  of  crack  sizes  can  be  used  to 
project  the  likelihood  of  future  failures  of  key  structural  details,  which  is  then  used  to  make 
decisions  regarding  how  often  future  inspections  should  be  conducted  or  whether  to  ground 
the  aircraft.  The  problem  with  using  the  cracks  found  during  an  inspection  is  that  the  larger 
cracks  are  more  likely  to  be  found  than  the  smaller  cracks.  There  is  an  inherent  bias  to  the 
sampling  procedure  when  relying  on  nondestructive  inspection  systems  to  find  the  cracks. 
Additional  complications  result  from  the  fact  that  the  crack  size  distribution  changes  in 
time  and  the  individual  aircraft  in  a  fleet  are  inspected  at  different  times.  Although  the 
nominal  inspection  period  may  be  500  hours,  aircraft  are  scheduled  for  inspections  based 
on  availability  and  operational  needs.  The  difference  in  inspection  times  must  also  be 
considered  when  using  crack  sizes  from  routine  maintenance  inspections. 

Two  models  are  developed  in  this  paper  to  account  for  the  impact  of  using  inspection 
results  to  estimate  flaw  size  distributions  in  aging  aircraft.  The  first  provides  the  basic 
structure  for  accommodating  the  bias  that  results  from  using  NDE  to  find  cracks.  In  the 
first  model,  all  inspections  are  assumed  to  have  occurred  at  the  same  time.  The  second 
method  incorporates  a  stochastic  crack  growth  model  that  is  commonly  used  to  make 


projections  of  aircraft  safety  to  account  for  inspections  made  at  different  flight  hours.  The 
last  part  of  this  paper  discusses  methods  for  improving  the  model  in  future  research. 

ANALYSIS  FOR  A  SINGLE  INSPECTION  TIME 

A  common  method  for  developing  estimates  of  parameters  of  a  model  for  the 
distribution  of  a  random  variable  is  the  method  of  maximum  likelihood  [6],  The  likelihood 
is  a  function  of  the  model  parameters  and  is  proportional  to  the  probability  density  function 
given  by  the  model.  It  is  referred  to  as  the  likelihood  because  values  of  the  random 
variable  have  already  been  collected  so  that  the  density  function  evaluated  at  the  observed 
data  represent  the  relative  likelihood  of  different  values  of  the  parameters.  Maximum 
likelihood  estimates  (MLE’s)  are  chosen  to  maximize  the  likelihood  for  the  observed  data. 
In  an  aging  aircraft,  each  location  that  is  inspected  could  have  a  crack,  however  most  of 
these  cracks  are  too  small  to  be  reliably  detected.  The  resulting  set  of  lengths  of  detected 
cracks  does  not,  therefore,  represent  a  complete  sample.  This  is  referred  to  as  censoring 
because  the  cracks  that  were  missed  in  the  inspection  should  have  been  part  of  the  sample 
but  were  eliminated  due  to  the  inadequacies  of  the  inspection  system.  The  likelihood 
function  must  be  modified  to  account  for  the  likelihood  of  censoring,  or  missing,  individual 
flaws. 

In  typical  reliability  studies,  censoring  is  based  on  a  fixed  value,  or  a  fixed  number  of 
failures.  For  example,  a  study  of  the  reliability  of  light  bulbs  may  test  100  light  bulbs  for 
1000  hours.  A  few  of  the  bulbs  will  fail  during  the  1000  hours  and  their  life  time  would  be 
known,  but  the  only  information  about  the  bulbs  that  didn’t;  fail  is  that  their  life  times  are 
longer  than  1000  hours.  In  estimating  flaw  size  distributions,  censoring  could  occur  at  any 
length,  because  even  large  flaws  have  a  small  chance  of  being  missed.  Censoring  is 
therefore  correlated  with  the  length  of  the  crack,  which  puts  a  different  twist  on  the 
standard  method  of  incorporating  censoring  into  the  likelihood  function. 

There  are  a  fixed  number  of  inspection  locations,  say  n,  that  are  examined  during  the 
programmed  maintenance  and  location  i  will  have  a  crack  of  length  a;  which  is  assumed  to 
be  a  random  variable  with  density  function  f(a;0)  where  0  is  a  vector  of  parameters  for  the 
flaw  size  distribution.  Assuming  the  inspection  reliability  is  known  to  be  POD(a)  then  the 
probability  that  the  crack  in  location  i  is  detected  is  POD(ai).  The  probability  that  a  random 
inspection  results  in  a  miss  is  given  by: 


*  00 

Q  =j(l -POD(a))f(a;0)da  (1) 

0 

which  incorporates  the  randomness  of  the  flaw  size  and  the  proportion  of  each  flaw  size 
that  will  be  missed.  The  likelihood  for  0  for  a  null  inspection  (that  is,  no  crack  indication) 
is  then  Q  (0).  The  probability  density  function  for  the  sizes  of  cracks  that  are  found  is: 

fD(a)  =  POD(a)f  (a;0)  /(l  -  Q*  )  (2) 

and  the  likelihood  of  0  for  a  crack  that  is  detected  and  found  to  have  size  a  is _/o(0;a).  The 
likelihood  function  for  a  complete  data  set  is  the  product  of  the  likelihoods  for  the 
individual  inspection  results. 


In  practice,  the  flaw  size  distribution  is  often  modeled  as  a  log  normal  distribution  and  the 
cumulative  lognormal  distribution  function  is  used  for  the  POD  function.  Using  these 
assumptions  the  contributions  to  the  likelihood  function  for  the  parameters  y  and  5  become 
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Where  p  and  a  are  the  parameters  of  the  POD  function  with  p  equal  to  the  logarithm  of  the 
crack  length  that  is  detected  50%  of  the  time  and  a  is  a  steepness  parameter  for  the  POD 
function. 

These  likelihood  equations  were  used  to  estimate  the  parameters  of  the  distribution  of  crack 
sizes  that  were  inspected  in  a  set  of  255  inspections  in  which  104  cracks  were  found.  A 
plot  of  the  apparent  crack  sizes  versus  time  of  inspection  is  shown  in  Figure  1 . 

Although  the  inspections  were  performed  at  different  times,  they  appear  to  be  a  random 
sample  from  a  lognormal  distribution.  Estimation  of  the  flaw  size  distribution  parameters 
was  implemented  assuming  that  there  was  no  time  difference  to  illustrate  the  basic  concept 
of  accounting  for  the  random  censoring. 
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FIGURE  1.  Apparent  crack  sizes  of  detected  cracks. 

Figure  2  Shows  a  plot  of  the  estimated  cumulative  distribution  function  of  the  cracks  that 
were  inspected.  Note  that  plot  of  the  maximum  likelihood  estimate  of  the  distribution 
function  is  well  to  the  left  of  the  empirical  distribution  function  of  the  sizes  of  the  cracks 
that  were  detected.  Incorporating  information  about  the  POD  function  has  corrected  for  the 
bias  of  seeing  a  larger  percentage  of  big  cracks. 


Figure  3  shows  a  similar  comparison  using  density  functions  instead  of  cumulative 


FIGURE  2.  Comparison  of  the  estimated  crack  size  distribution  function  with  the  apparent  distribution  of 
detected  cracks. 
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FIGURE  3.  Comparison  of  the  estimated  density  function  of  the  crack  size  distribution  with  the  distribution 
of  detected  cracks. 

distribution  functions.  The  dashed  line  shows  the  estimate  of  the  density  function  that 
would  result  from  only  using  the  cracks  that  were  detected,  while  the  solid  line  shifted  to 
the  left  shows  the  impact  of  accounting  for  random  censoring  that  is  correlated  with  crack 
size.  The  censored  estimates  put  more  weight  on  smaller  cracks  which  are  detected  less 
frequently. 


ANALYSIS  FOR  INSPECTIONS  PERFORMED  AT  DIFFERENT  TIMES 


The  impact  of  the  time  of  the  inspection  was  not  accounted  for  in  this  analysis.  A 
second  analysis  was  attempted  to  account  for  the  change  in  the  flaw  size  distribution  as  a 
function  of  time.  The  model  that  was  used  to  project  the  change  of  the  flaw  size 
distribution  in  time  is  the  model  used  to  generate  equivalent  initial  flaw  sizes  and  is  often 
used  in  risk  analyses  of  aging  aircraft.  The  concept  is  that  percentiles  of  the  flaw  size 
distribution  follow  the  nominal  crack  grow  curve  for  the  structural  detail  in  time.  Figure  4 
shows  a  schematic  of  the  concept. 

The  impact  of  information  about  the  crack  growth  model  is  that  the  flaw  size  distribution 
has  an  additional  parameter  to  specify  the  time  of  the  inspection.  The  crack  growth  curve 
for  the  structural  detail  that  was  used  in  this  study  is  a  close  fit  to  an  exponential  curve. 
With  the  assumption  of  the  log  normal  distribution  for  the  initial  flaw  size,  and  an 
exponential  crack  growth  curve,  the  distribution  of  flaws  at  time  t  is  also  an  exponential 
distribution  with  mean  and  standard  deviation  of  logarithm  of  crack  length  of  y  +  A*t  and  8 
where  y  is  the  mean  of  the  logarithm  of  crack  size  at  time  0,  X  is  the  exponential  growth 
parameter  and  8  is  the  standard  deviation  of  the  logarithm  of  crack  length. 


The  specific  likelihood  functions  for  lognormal  crack  sizes,  exponential  crack  growth  and 
the  lognormal  POD  function  become: 
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where  y  and  8  are  the  mean  and  standard  deviation  of  the  logarithm  of  crack  length  for  the 
crack  size  distribution  at  time  0.  This  would  typically  be  the  equivalent  initial  crack  size 
distribution. 

The  SAS  software  converged  to  estimates  of  y  and  8  indicating  strong  statistical 
significance,  however,  a  plot  of  the  data  indicates  problems  with  the  crack  growth  model. 
Figure  5  shows  the  indicated  crack  sizes  versus  time  of  inspection,  overlaid  with  plots  of 
percentiles  of  the  crack  size  distribution  based  on  the  stochastic  crack  growth  model.  It  is 
clearly  evident  that  the  indicated  crack  sizes  do  not  follow  this  model.  The  statistical  test  in 
the  SAS  routine  did  not  address  the  adequacy  of  the  model,  only  whether  or  not  the 
parameters  are  equal  to  0. 
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FIGURE  4.  Schematic  of  the  stochastic  crack  growth  model. 
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FIGURE  5.  Comparison  of  crack  sizes  with  the  stochastic  crack  growth  model 

One  reason  the  model  did  not  fit  well  is  that  the  equivalent  initial  flaw  size  (EIFS)  concept 
may  not  model  crack  growth  in  real  aircraft  usage.  The  EIFS  concept  was  developed 
primarily  in  laboratory  tests  which  are  highly  controlled.  It  is  not  unreasonable  that  the 
variability  in  usage  and  environment  would  cause  problems  with  the  model. 

Another  possible  problem  is  that  the  indicated  crack  lengths  used  in  this  study  were  derived 
from  the  signal  response  of  the  NDE  system,  not  from  direct  measurements  of  the 
cracks.  It  is  possible  that  inspectors  tend  to  calibrate  signal  response  to  a  constant  range  of 
crack  lengths,  and  that  the  time  dependence  is  lost.  In  this  case,  the  first  analysis  is 
appropriate,  however,  the  crack  length  distribution  would  pertain  to  the  indicated  crack 
sizes  from  the  signal  response  rather  than  the  true  crack  size  distribution. 


SIMULATION  STUDY 


A  simulation  study  was  conducted  to  demonstrate  the  potential  for  the  analysis  method  if 
accurate  flaw  size  data  are  available.  The  exponential  crack  growth  curve  model  was  used 
along  with  a  lognormal  equivalent  initial  flaw  size  distribution.  The  parameter  values  were 
chosen  to  approximate  the  real  data  that  were  collected.  The  mean  and  standard  deviation 
of  the  mean  crack  size  for  the  initial  flaw  size  distribution  were  y  =  -7.5,  8  =  0.7  which 
correspond  to  a  median  crack  size  of  0.00055  inches  and  a  90th  percentile  crack  length  of 
0.0017  inches.  The  exponential  crack  growth  rate  parameter  was  X  =  0.000463  and  the 
POD  parameters  were  p  =  -3.5  and  a  =  0.5,  which  correspond  to  a  crack  length  that  is 
detected  50%  of  the  time  of  0.03  inches  and  a  crack  length  that  is  detected  90%  of  the  time 
of  0.069  inches. 

Figure  6  shows  a  plot  of  the  lengths  of  detected  cracks  versus  time  for  the  simulated  data. 
Inspections  were  simulated  at  various  times  in  the  life  of  the  aircraft  to  approximate 
realistic  aircraft  experience.  The  exponential  crack  growth  relationship  is  somewhat 
apparent  in  the  figure.  Figure  7  plots  the  fitted  crack  growth  model  on  top  of  the  data  from 
Figure  6  along  with  plots  of  the  lengths  of  the  cracks  that  were  missed.  The  fitted  crack 
growth  percentiles  show  a  good  fit  to  the  simulated  crack  growth  data. 

RECOMMENDATIONS  AND  CONCLUSIONS 

This  study  has  shown  the  need  to  account  for  the  selection  bias  induced  by  using 
NDE  to  find  cracks  when  estimating  the  distribution  of  cracks  that  are  in  the  aircraft.  An 
attempt  was  made  to  incorporate  a  commonly  used  stochastic  crack  growth  model  to 
accommodate  inspections  performed  at  different  points  in  the  life  of  the  aircraft.  Problems 
with  the  manner  in  which  flaw  sizes  were  determined  were  identified  that  could  invalidate 
the  estimates  that  incorporate  a  crack  growth  model  to  account  for  the  time  of  inspection. 


FIGURE  6.  Simulated  sizes  of  cracks  that  were  found  at  various  inspection  times 
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FIGURE  7.  Plot  of  the  model  fit  for  simulated  data. 

A  simulation  study  demonstrated  the  ability  of  the  technique  when  accurate  flaw  sizes  are 

available  for  detected  cracks.  Future  work  should  place  an  emphasis  on  collecting 

inspection  results  with  crack  lengths  that  have  been  verified  by  independent  means. 
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